Dual-aperture zoom digital camera with automatic adjustable tele field of view

ABSTRACT

Digital camera comprising an upright Wide camera configured to provide a Wide image with a Wide image resolution and a folded Tele camera configured to provide a Tele image with a Tele image resolution higher than the Wide image resolution, the Wide and Tele cameras having respective Wide and Tele fields of view FOV W  and FOV T  and respective Wide and Tele image sensors, the digital camera further comprising a rotating OPFE operative to provide a folded optical path between an object or scene and the Tele image sensor, wherein rotation of the OPFE moves FOV T  relative to FOV W . In some embodiments, a rectangular FOV T  is orthogonal to a rectangular FOV W . When included in a host device having a user interface that displays FOV T  within FOV W , the user interface may be used to position FOV T  relative to FOV W , scan FOV T  across FOV W  and acquire, store and display separate Wide and Tele images, composite Wide plus Tele images and stitched Tele images. The positioning of FOV T  within FOV W , can be done automatically (autonomously) by continuously tracking an object of interest.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/525,059 filed May 6, 2017 (now allowed), which was a 371 applicationfrom international patent application PCT/IB2016/057366 filed Dec. 5,2016 and claims priority from U.S. Provisional Patent Applications No.62/272,367 filed on Dec. 29, 2015 and 62/361,150 filed on Jul. 12, 2016,both of which are expressly incorporated herein by reference in theirentirety.

FIELD

Embodiments disclosed herein relate in general to digital cameras and inparticular to thin zoom digital cameras.

BACKGROUND

Host devices or “personal computing and/or communication devices” (suchas smartphones) having two back cameras (also referred to as“dual-camera” or “dual-aperture camera”) are known, see e.g. U.S. Pat.No. 9,185,291. The two back cameras have two image sensors (or simply“sensors”) operated simultaneously to capture an image, and have lenseswith different focal lengths. Even though each lens/sensor combinationis aligned to look in the same direction, each will capture an image ofthe same scene but with two different fields of view (FOV).

Dual-aperture zoom cameras in which one camera has a “Wide” FOV(FOV_(W)) and the other has a narrow or “Tele” FOV (FOV_(T)) are alsoknown, see e.g. U.S. Pat. No. 9,185,291. The cameras are referred torespectively as Wide and Tele cameras that include respective Wide andTele sensors. These sensors provide respectively separate Wide and Teleimages. The Wide image captures FOV_(W) and has lower spatial resolutionthan the Tele image that captures FOV_(T). As used herein, “FOV” isdefined by the tangent of the angle between a line crossing the lens andparallel to the lens optical axes and a line between the lens and anyobject that is captured on the respective image corner. The images maybe merged (fused) together to form a composite image. In the compositeimage, the central portion is formed by combining the relatively higherspatial resolution image taken by the lens/sensor combination with thelonger focal length, and the peripheral portion is formed by aperipheral portion of the relatively lower spatial resolution imagetaken by the lens/sensor combination with the shorter focal length. Theuser selects a desired amount of zoom and the composite image is used tointerpolate values from the chosen amount of zoom to provide arespective zoom image. Hereinafter, the use of “resolution” in thisdescription refers to image spatial resolution, which is indicative tothe resolving power of a camera as determined by the lens focal length,its aperture diameter and the sensor pixel size.

Dual-aperture cameras in which one image (normally the Tele image) isobtained through a folded optical path are known, see e.g. co-inventedand co-owned U.S. patent application Ser. No. 14/455,906, which teacheszoom digital cameras comprising an “upright” (with a direct optical axisto an object or scene) Wide camera and a “folded” Tele camera, see alsoFIG. 2B below. The folded camera has an optical axis substantiallyperpendicular (orthogonal) to an optical axis of the upright camera. Thefolded Tele camera may be auto-focused and optically stabilized bymoving either its lens or by tilting an optical path folding(reflecting) element (e.g. a prism or mirror and referred to also as“OPFE”) inserted in an optical path between its lens and a respectivesensor. For simplicity, the optical path folding element is referred tohereinafter in this description generically as “prism”, with theunderstanding that the term may refer to any other optical path folding(reflecting) element that can perform the function of folding an opticalpath as described herein.

For example, PCT patent application PCT/IB2016/056060 titled“Dual-aperture zoom digital camera user interface” discloses a userinterface for operating a dual-aperture digital camera included in hostdevice, the dual-aperture digital camera including a Wide camera and aTele camera, the user interface comprising a screen configured todisplay at least one icon and an image of a scene acquired with at leastone of the Tele and Wide cameras, a frame defining FOV_(T) superposed ona Wide image defined by FOV_(W), and means to switch the screen fromdisplaying the Wide image to displaying the Tele image. The userinterface further comprises means to switch the screen from displayingthe Tele image to displaying the Wide image. The user interface mayfurther comprise means to acquire the Tele image, means to store anddisplay the acquired Tele image, means to acquire simultaneously theWide image and the Tele image, means to store and display separately theWide and Tele images, a focus indicator for the Tele image and a focusindicator for the Wide image.

Object recognition is known and describes the task of finding andidentifying objects in an image or video sequence. Many approaches havebeen implemented for accomplishing this task in computer vision systems.Such approaches may rely on appearance based methods by using exampleimages under varying conditions and large model-bases, and/or on featurebased methods comprising of a search to find feasible matches betweenobject features and image features, e.g., by using surface patches,corners and edges detection and matching. Recognized objects can betracked in preview or video feeds using an algorithm for analyzingsequential frames and outputting the movement of targets between theframes.

The problem of motion-based object tracking can be divided into twoparts:

(1) detecting moving objects in each frame. This can be done either byincorporating an object recognition algorithm for recognizing andtracking specific objects (e.g., human face) or, for example, bydetecting any moving object in a scene. The latter may incorporate abackground subtraction algorithm based on Gaussian mixture models withMorphological operations applied to the resulting foreground mask toeliminate noise. Blob analysis can later detect groups of connectedpixels, which are likely to correspond to moving objects.

(2) associating the detections corresponding to the same object overtime, e.g., using motion estimation filters such as the Kalman filter.

SUMMARY

In exemplary embodiments, there are provided digital cameras comprisingan upright Wide camera configured to provide a Wide image with a Wideimage resolution, the Wide camera comprising a Wide image sensor and aWide lens with a Wide field of view (FOV_(W)); a folded Tele cameraconfigured to provide a Tele image with a Tele image resolution higherthan the Wide image resolution, the Tele camera comprising a Tele imagesensor and a Tele lens with a Tele field of view (FOV_(T)); and arotating OPFE (e.g. prism) operative to provide a folded optical pathbetween an object or scene and the Tele sensor, wherein rotation of theprism moves FOV_(T) relative to FOV_(W).

In an embodiment, the Wide and Tele image sensors have a substantiallyrectangular shape defined by a respective height dimension and arespective width dimension and are in orthogonal planes and with theirrespective height dimensions orthogonal to each other such that FOV_(T)is rotated at 90 degrees to FOV_(W).

In an embodiment, the movement of FOV_(T) relative to FOV_(W) isperformed in a scanning mode that provides a plurality ofpartially-overlapping or adjacent non-overlapping

Tele FOVs within FOV_(W).

In an embodiment, the prism rotation has a range of up to ±15 degreesaround a zero prism position in which FOV_(T) is centric to FOV_(W).

In an embodiment, the digital camera may be included in a host devicehaving a user interface for operating the digital camera, the userinterface comprising a screen configured to display at least one iconand an image of the object or scene acquired with at least one of theTele and Wide cameras and to display a frame defining FOV_(T) withinFOV_(W). The host device may have a user interface for operating thedigital camera, the user interface comprising a screen configured todisplay at least one icon and an image of the object or scene acquiredwith at least one of the Tele and Wide cameras and to display a framedefining FOV_(T) within FOV_(W). In an embodiment, the user interfacemay further comprise means for moving FOV_(T) relative to FOV_(W). In anembodiment, the user interface may further comprise means for scanningFOV_(T) across FOV_(W). In an embodiment, the user interface may furthercomprise means for switching the screen from displaying the Wide imageto displaying the Tele image. In an embodiment, the user interface mayfurther comprise means to acquire the Tele image. In an embodiment, theuser interface may further comprise means to acquire simultaneously theWide image and the Tele image.

In an embodiment, the user interface may further comprise means toautomatically (autonomously) move the FOV_(T) relative to FOV_(W) totrack object of interest. In such cases, the camera may also be referredto as an “autonomous” camera.

In an embodiment, the user interface may further comprise means toacquire video streams of the Wide and Tele camera simultaneously.

In an embodiment, Tele images representing are plurality of adjacentnon-overlapping Tele FOVs are stitched together to form a stitched Teleimage used in the fusion with the Wide image.

In an embodiment, at least one Tele image includes a plurality ofconsecutive Tele images stitched together to form a stitched Tele imageused in a fusion procedure with the Wide image to provide a compositeimage.

In an embodiment, the Wide and Tele images or video streams can be fused(or combined or stitched) on the device or in a cloud environment(referred to simply as “cloud”).

In an embodiment, the digital camera is further configured to form acomposite video stream in which each frame is based on either aprocessed Wide image or a processed Tele image, the processed Wide andTele images acquired during the autonomous FOV_(T) tracking.

BRIEF DESCRIPTION OF THE DRAWINGS

Non-limiting examples of embodiments disclosed herein are describedbelow with reference to figures attached hereto that are listedfollowing this paragraph. Identical structures, elements or parts thatappear in more than one figure are generally labeled with a same numeralin all the figures in which they appear. The drawings and descriptionsare meant to illuminate and clarify embodiments disclosed herein, andshould not be considered limiting in any way.

FIG. 1A shows schematically an image reflecting the Wide FOV of a scene;FIG. 1B shows schematically an image reflecting the Tele FOV of thescene in FIG. 1A;

FIG. 2A shows schematically a dual-aperture camera comprising a firstupright camera and a second folded camera, with a prism folding anoptical path to the folded camera in a zero position;

FIG. 2B shows a composite image obtained with a dual-aperture camera asin FIG. 2A, with the Tele FOV resulting from the zero position of theprism;

FIG. 3 shows schematically an arrangement enabling tilt of a prism in afolded optical path;

FIG. 4A shows schematically the dual-aperture camera of FIG. 2A with theprism rotated to a first position;

FIG. 4B shows a composite image obtained with a dual-aperture camera asin FIG. 4A, with the Tele FOV resulting from the first prism position;

FIG. 5A shows schematically the dual-aperture camera of FIG. 2A with theprism rotated to a second position;

FIG. 5B shows a composite image obtained with a dual-aperture camera asin FIG. 5A, with the Tele FOV resulting from the second prism position;

FIG. 6A shows schematically a dual-aperture camera comprising a firstupright camera with a sensor rotated by 90 degrees relative to that inthe camera of FIG. 2A and with a prism folding an optical path to afolded camera in a zero position;

FIG. 6B shows a composite image obtained with a dual-aperture camera asin FIG. 6A, with the Tele FOV resulting from the zero position of theprism;

FIG. 7A shows schematically the dual-aperture camera of FIG. 6A with theprism rotated to a first position;

FIG. 7B shows a composite image obtained with a dual-aperture camera asin FIG. 7A, with the Tele FOV resulting from the first prism position;

FIG. 8A shows schematically the dual-aperture camera of FIG. 6A with theprism rotated to a second position;

FIG. 8B shows a composite image obtained with a dual-aperture camera asin FIG. 7A, with thr Tele FOV resulting from the first prism position;

FIG. 8A shows schematicall the dua-aperature camera of FIG. 6A with theprism rotated to a second position;

FIG. 8B shows a composte image obtained with a dual-aperature camera asFIG. 8A, with the Tele FOV resulting from the second prism position;

FIG. 9A shows a smartphone and user interface incorporating adual-aperture camera with Tele FOV positioning capability disclosedherein in a zero, centered position on the smartphone screen;

FIG. 9B shows the smartphone and user interface of FIG. 9A with the TeleFOV moved to a down position within the screen;

FIG. 9C shows the smartphone and user interface of FIG. 9A with the TeleFOV moved to an up position within the screen;

FIG. 9D shows the smartphone and user interface of FIG. 9A with the TeleFOV rotated by 90 degrees relative to the Wide FOV and moved to a rightposition within the screen;

FIG. 9E shows the smartphone and user interface of FIG. 9A with the TeleFOV rotated by 90 degrees relative to the Wide FOV and moved to a leftposition within the screen;

FIG. 10 shows a smartphone and user interface as in FIGS. 9D or 9E usedin a scanning mode of the Tele FOV.

FIG. 11A shows a smartphone and user interface incorporating adual-aperture camera with automatic Tele FOV tracking disclosed hereinwith a first Tele FOV position on the smartphone screen;

FIG. 11B shows the smartphone and user interface of FIG. 11A with asecond Tele FOV position on the smartphone screen;

FIG. 11C shows the smartphone and user interface of FIG. 11A with athird Tele FOV position on the smartphone screen.

DETAILED DESCRIPTION

FIG. 1A shows schematically an image (or frame of a video stream) 102reflecting the

Wide FOV of a scene 106. FIG. 1B shows schematically an image (or frameof a video stream) 104 reflecting the Tele FOV of scene 106. Only partof the scene of FIG. 1A is seen in FIG. 1B. The two images or videostreams are obtained simultaneously with a dual-aperture camera havingan upright Wide camera and a folded Tele camera of the type for exampledisclosed in U.S. patent application Ser. No. 14/455,906. The twocameras may, for example, be two back cameras included in a smartphoneor in another personal communication device.

FIG. 2A shows schematically a dual-aperture camera 200 comprising afirst upright camera 202 and a second folded camera 204. An XYZcoordinate system as shown is used in the description of this and allfollowing “camera” drawings. For example, upright camera 202 is a Widecamera that includes a Wide lens assembly (or simply “lens”) 206 with anoptical axis 207, and a Wide sensor 208. For example, folded camera 204is a Tele camera that includes a Tele lens 210 with an optical axis 211,and a Tele sensor 214. An OPFE (e.g. prism) 212 may be part of thefolded Tele camera or may be a separate element that folds an opticalpath parallel to axis 207 into an optical path parallel to axis 211 intothe Tele lens. The Wide and Tele sensors lie in respective orthogonalplanes, respectively the XZ plane and the XY plane. For example, theWide and Tele sensors are substantially rectangular with respectiveheight (H) and width (W) dimensions. Thus, Wide sensor 208 has a heightH_(W) and a width W_(W) and Tele sensor 214 has a height H_(T) and awidth W_(T). The H/W ratio in both sensors is typically (although notnecessarily) 9/16 or ¾. In the folded camera, positioning of sensor 214with its height in the Y direction is advantageous in that it allows asmaller host device (e.g. a smartphone) thickness. In camera 200 in FIG.2A (as well as cameras 200 in FIGS. 3, 4A and 5A), the width dimensionsof sensors 208 and 214 are parallel to each other and to the X-axis.

The operation of a camera such as camera 200 is described in more detailin U.S. patent application Ser. No. 14/455,906. In particular, the prismcan perform a tilt (rotation) movement 216 around the X-axis as shown.The rotation motion may be caused by a stepping motor 302 shownschematically in FIG. 3. The prism rotation angle may range between −15degrees and +15 degrees around a “zero” position (see below),corresponding to ±30 degrees FOV_(T) shift. Cameras 202 and 204 are usedfor example to take respectively the Wide and Tele images of FIGS. 1Aand 1B.

FIG. 2B shows an image 230 identical with Wide image 102 with a frame232 that indicates the position of the Tele image FOV. The camera canhave high resolution in this framed FOV either by fusing the Wide andTele images or by capturing and saving the Tele image. For referencepurposes, the position of the prism that causes the Tele FOV andresulting image to be centric to the Wide FOV and Wide image is calledhere for example and in a non-limiting way a “zero” position of theprism.

The rotation of prism 212 around the X-axis moves the Tele FOV relativeto the Wide FOV, causing other portions of scene 106 to become a “Teleimage” with higher resolution. Thus, FIG. 4A shows prism 212 rotatedcounter-clockwise (as indicated by a curved arrow 402 when viewed in the−X direction) around the X-axis from its zero position to a new, firstposition. The counter-clockwise rotation causes the Tele FOV, indicatedby frame 232, to move to a new, “down” position relative to the Wide FOVindicated by frame 230. FIG. 5A shows prism 212 rotated clockwise (asindicated by a curved arrow 502 when viewed in the—X direction) aroundthe X-axis from its zero position to a new, second position. Theclockwise rotation causes the Tele FOV, indicated by frame 232, to moveto another new, “up” position relative to the Wide FOV indicated byframe 230. While FIGS. 4A, 4B, 5A and 5B show two discrete prismrotation movements and two discrete Tele FOV positions relative to theWide FOV, there is clearly an entire range of practically continuouspositions that the Tele FOV may occupy, depending on the degree anddirection of prism rotation.

As mentioned, in FIGS. 2A, 3, 4A and 5A, both Wide sensor 208 and Telesensor 214 are positioned with their longer side (“width”) in the Xdirection. Their shorter side (“height”) is in the Z direction forsensor 208 and in the Y direction for sensor 214. FIG. 6A showsschematically a dual-aperture camera 200′ comprising an upright camera206 with a Wide sensor 208′ rotated by 90 degrees relative to sensor 208in camera 206 of FIG. 2A. As also shown in FIGS. 7A and 8A, Wide sensor208′ now has its height in the X direction and its width in the Zdirection. Note that W_(W) is now also orthogonal to the H_(T). This 90degree in-plane rotation of the Wide sensor provides certain advantagesin terms of the positioning and movement of FOV_(T) relative to FOV_(W),and consequently in terms of the capture, processing and display of Teleand Wide images. One major advantage is that a larger percentage ofFOV_(W) can have high resolution by setting a prism rotation angle. FIG.6B shows schematically the position of FOV_(T) 232′ (now rotated by 90degrees relative to FOV_(W) 230) in a centered position caused by a zeroposition of prism 212, after the camera itself was rotated by 90 degrees(not shown) compared to the camera of FIG. 2B.

FIG. 7A shows schematically the dual-aperture camera of FIG. 6A withprism 212 rotated counter-clockwise (as indicated by a curved arrow 702when viewed in the −X direction) around the X-axis from its zeroposition to a new position. As shown in FIG. 7B, this prism rotationcauses Tele FOV 232′ to move to a “right” position relative to the WideFOV. FIG. 8A shows prism 212 rotated clockwise (as indicated by a curvedarrow 802 when viewed in the −X direction) around the X-axis from itszero position to a second position, As shown in FIG. 8B, this prismrotation causes Tele FOV 232′ to move to a “left” position relative tothe Wide FOV. While FIGS. 7A, 7B, 8A and 8B show two discrete prismrotation movements and two discrete Tele FOV positions relative to theWide FOV, there is clearly an entire range of practically continuouspositions that the Tele FOV may occupy, depending on the degree anddirection of prism rotation.

Note that a similar FOV_(T) relative positioning effect to thatdescribed above may be obtained by in-plane rotating Tele sensor 214 by90 degrees and by leaving Wide sensor 208 unchanged from its originalposition in FIG. 2A. However, the positioning of sensor 214 with W_(T)in the Y direction may disadvantageously increase a camera height (andtherefore a host device thickness).

When a dual-aperture camera described above is included for example in asmartphone, the Tele image (i.e. the part of scene 106 viewed andacquired by the Tele camera) is bound by a frame 932 visible on thesmartphone screen. FIG. 9A shows an exemplary smartphone 900 thatincludes on a back side (not shown) a Wide camera and a Tele camera asin FIGS. 2A or 6A. The Wide and Tele cameras have known fields of viewwith a known ratio M=FOV_(T)/FOV_(W) between them. In general, M mayhave any value between ¼ and ¾. For example, M may have values of ½,9/16 or ¾. Consequently, frame 932 includes almost exactly the imageseen by FOV_(T) and has a size that is a fraction M of the entire screen(which includes the image seen by FOV_(W)). Note that for cameraconfiguration as the one shown in FIG. 6A and for Wide and Tele imagesensors with 4:3 aspect ratio, selecting M= 3/4 will result in FOV_(T)that will overlap the short dimension of FOV_(W) in its entirety andwill enable complete scanning of the Wide FOV by tilting the prism. Thesame argument is applicable for image sensors having 16:9 aspect ratiowith M= 9/16.

In still mode, scene 106 is acquired by both cameras, with the Widecamera providing the entire image seen (i.e. the Wide image) and theTele camera providing the part of scene 106 bound by frame 932.Smartphone 900 further includes, on a front side opposite to the backside, a screen or display 902 displaying a view of scene 106. Screen 902may display icons or text “A”, “B”, “C”, etc., that provide indicationsand/or are selectable to perform various operations of the phone and/orthe cameras. Such icons or text may be indicative of flash setting,video or stills selection, back or front camera selection, etc. Thesquare boxes surrounding “A”, “B” and “C” are merely illustrative andmay have different shape or be removed altogether in some cases. Notethat the fact that only three icons are shown is not meant to belimiting, and that more or fewer icons may be displayed and/orselectable at any time during or prior to image acquisition by thecameras and/or during display of acquired images. In an embodiment ofthe dual-aperture camera as in FIG. 2A, the “zero” position of the prismprovides the composite image seen in FIG. 9A, where frame 932 iscentered on the screen.

In various embodiments and as described in more detail inPCT/IB2016/056060, smartphone 900 may have a user interface thatincludes a single camera icon (or “button”) 908 and a “two-camera”button 910. The two-camera button may appear on the screen when the FOVof the scene (FOV_(scene)) is greater or equal to FOV_(T). As describedin detail in PCT/IB2016/056060, the user interface displays visually thealmost exact FOV_(T) and enables simple acquisition of the image withinFOV_(T), thereby providing a Tele image with the highest resolutionenabled by the Tele camera. The user interface also enables simultaneousacquisition (with a single input through the user interface, i.e. usingtwo-camera button 910) of a Wide image and a Tele image. Image fusion ofthe Wide and Tele images or video streams can take place on thecapturing device or in a cloud environment.

The present inventors have determined that, advantageously, a userinterface as described above can be used to “drag” frame 932 (andFOV_(T)) on screen 902 to bring different parts of the scene intoFOV_(T). That is, the dragging of frame 932 is translated into rotationof the “folded” path prism, such that the higher resolution Tele image“moves” to different parts of the scene. The dragging may be performedby a firm touch of the screen by a finger 920 and movement of the fingeracross the screen. In FIG. 9A, the finger touches the screen in thegeneral area of “zero” positioned (centered) frame 932. The finger maydrag the frame (and FOV_(T)) to a “down” position as in FIG. 9B, to an“up” position as in FIG. 9C, or to any intermediate position (not shown)between the down and up positions. The touch and drag actions arerelayed to a camera controller (not shown), which, in turn, controls theprism movement. The dragging of frame 932 to the down position in FIG.9B, indicated schematically by an arrow 934, is equivalent to rotationof the prism to its position in FIG. 4A. The dragging of frame 932 tothe up position in FIG. 9C is equivalent to rotation of the prism to itsposition in FIG. 5A. Similarly, with a dual-aperture camera with a 90degree rotated Wide sensor as in FIGS. 6A-8A, a frame 932′ (now alsorotated by 90 degrees relative to frame 932 in FIGS. 9A-9C) may bedragged from a zero position to a “right” position as in FIG. 9D or a“left” position as in FIG. 9E. The dragging of frame 932′ to the rightposition in FIG. 9D is equivalent to rotation of the prism to itsposition in FIG. 7A. The dragging of frame 932′ to the up position inFIG. 9E is equivalent to rotation of the prism to its position in FIG.8A.

As described in detail in PCT/IB2016/056060, in terms of imageacquisition, a user may press two-camera button 910 to simultaneouslyacquire two images, the Wide image of scene 106 at its respective(lower) image resolution and the Tele image of region (frame) 932 (or932′) at its respective (higher) image resolution. The two images may bestored in an on-board storage (such as “camera roll” in an iPhone) andmay be displayed or downloaded for further use as known in the art. Theuser may press single camera button 908 to acquire only the Wide image,which can further be stored, displayed and downloaded for further use.The user may choose for display on screen 902 only the Tele image by,for example, double-tapping or pressing at any point on the screenwithin frame 932 (or 932′). This action leads to display of the Teleimage on the entire screen. The Tele image (only) can then be chosen foracquisition by pressing on single camera button 908. The acquired Teleimage can then be stored, displayed and downloaded for further use asabove. The two images can also be fused (on the camera hosting device orin a cloud) into a composite image with a portion marked by a frame 932or 932′ formed by the higher-resolution Tele image, and with aperipheral portion formed by a peripheral portion of the relativelylower resolution Wide image.

Clearly, frame 932′ (and the Tele FOV) may be dragged to anyintermediate position (not shown) between the right and left positions.In other words, the Tele FOV may be moved laterally on the screen to anumber of partially overlapping or non-overlapping (but touching)positions, from a right-most position (at a right screen edge 940) to aleft-most position (at a left screen edge 942) or vice-versa, and anentire image of the scene may be “stitched” together from the partiallyoverlapping or non-overlapping Tele images. For example, as shown inFIG. 10, the ratio M of the Tele and Wide FOVs may be such that screen902 includes, and is substantially covered by, four adjacent frames932′a-d. Note that the screen may include fewer adjacent frames than thenumber required to substantially fill in the entire screen. For example,in an embodiment, there may be only two or three adjacent frames(instead of the four shown). An optional “Scan” icon or button 1002 maythen be used to scan (i.e. move the FOV_(T) frame) automatically from aright-most position on the screen (i.e. from frame 932′a) to a left-mostposition (i.e. to frame 932′d) or vice-versa. Alternatively, a “Scan”command may be given by voice control. The scan function, similarly tothe dragging action, provides partially overlapping or non-overlappingTele images that can be stitched together into a high-resolution Teleimage of the entire scene. A scan command, whether through icon 1002 orvocally, may also lead to acquisition of each Tele image defined by aframe 932′ and to its storage for further processing. A Wide image canbe captured during the scan function, allowing further processing thatmay include image fusion of the Wide image with the various Tele images(or the stitched Tele images) to form a high resolution image with a FOVthat is larger than FOV_(T).

Note that the direction of prism rotation and the consequent movement ofFOV_(T) relative to FOV on a smartphone (or any other host device)screen depends on the geometry of the assembly of the dual-aperturecamera in the host device. The description above relates to oneparticular such geometry. In a different geometry, the prism rotationdirections and the resulting FOV_(T) movement may be in oppositedirections to those described above.

The devices, used interface and associated methods disclosed above maybe used for automatic movement or “automatic adjustment” of the Tele FOVfor e.g. tracking a subject in an autonomous manner We refer to a cameramode that performs automatic Tele FOV movement to track an object orsubject of interest as “autonomous Tele FOV tracking”. The autonomousTele FOV movement is in response to recognition (through e.g. thesmart-phone camera) of the object or subject of interest, and the Teleimage focuses on and displays the object or subject of interest. Theobject recognition may be performed using any of the methods known inthe art. An example of autonomous Tele FOV tracking is shown in FIGS.11A-11C.

FIG. 11A shows a smartphone and user interface incorporating adual-aperture camera with automatic Tele FOV tracking disclosed hereinwith a first Tele FOV position on the smartphone screen. FIG. 11B showsthe smartphone and user interface of FIG. 11A with a second Tele FOVposition on the smartphone screen. FIG. 11C shows the smartphone anduser interface of FIG. 11A with a third Tele FOV position on thesmartphone screen. In each of these figures, the object of interest is arunner 1102. The decision to track the runner is taken either by theuser (e.g., by touching the runner's image) or automatically (e.g.,using face detection). It is assumed that the Tele camera can change itsFOV by tilting the prism to track the object of interest. Ideally, thecamera will track the object such that it is as close as possible to thecenter of the adjustable Tele FOV as seen in 1032 a, 1032 b and 1032 c.

While the smartphone shown in FIGS. 11A-11C displays icons 908, 910 and1002, one or more other icons (not shown) may replace and/or be used_inaddition to or instead of icons 908, 910 and 1002 during operation inthe Tele FOV tracking mode.

Wide and Tele images and/or video streams can be recorded during theautomatic tracking mode and fused together to form a composite image orcomposite video stream. This fusion can be applied on the camera hostingdevice or alternatively, Wide and Tele images or video streams can beuploaded to the cloud for applying this fusion operation. Each compositeimage may also be formed with FOV_(W) by scanning with the Tele camera,stitching a plurality of Tele images to provide a “stitched” Tele image,then fusing the stitched Tele image with the Wide image. This isadvantageous in that the Wide image captures the entire scenesimultaneously, while the Tele images to be stitched together areconsecutive, so one can overcome motion or occlusions in the scene ifrequired. The stitching of the Tele images and/or the fusion of thestitched Tele image with the Wide image may also be performed in acloud.

While this disclosure has been described in terms of certain embodimentsand generally associated methods, alterations and permutations of theembodiments and methods will be apparent to those skilled in the art.The disclosure is to be understood as not limited by the specificembodiments described herein, but only by the scope of the appendedclaims.

What is claimed is:
 1. A method for obtaining a high-resolution imageusing a dual-aperture camera comprising a Wide camera that provides aWide image with a Wide resolution and a Wide field of view (FOV_(W)),and a folded Tele camera that provides plurality of Tele images with aTele resolution higher than the Wide camera resolution and with a Telefield of view (FOV_(T)) smaller than the FOV_(W), wherein the Widecamera includes a Wide lens with a Wide lens optical axis and a Wideimage sensor with a width W_(W) and a height H_(W), wherein the Telecamera includes a Tele image sensor with a width W_(T) and a heightH_(T), wherein W_(W)>H_(W) and wherein W_(T)>H_(T), the methodcomprising: a) positioning H_(T) in parallel with the Wide lens opticalaxis and W_(W) orthogonally to H_(T); b) obtaining a first Tele imagewith the FOV_(T) at a first position within the FOV_(W); c) moving theFOV_(T) relative to FOV_(W) to obtain a second Tele image with theFOV_(T) at a second position within the FOV_(W); and d) fusing the Wideimage, the first Tele image and the second Tele image into a fusedimage.
 2. The method of claim 1, wherein the second Tele image partiallyoverlaps the first Tele image.
 3. The method of claim 1, wherein thesecond Tele image does not overlap the first Tele image.
 4. The methodof claim 1, wherein the moving is performed manually.
 5. The method ofclaim 1, wherein the moving is performed automatically.
 6. The method ofclaim 1, wherein each of the first Tele image and the second Tele imageis indicated on a screen of the dual-aperture camera by a respectiveframe visible on the screen showing and defining the FOV_(T).
 7. Themethod of claim 1, wherein the obtaining a first Tele image with theFOV_(T) at a first position within the FOV_(W) is preceded by detectingan area of interest within the FOV_(W) that includes the first position.8. The method of claim 1, wherein the moving the FOV_(T) relative to theFOV_(W) includes moving the FOV_(T) relative to the FOV_(W) to obtain aplurality of additional Tele images with the FOV_(T) at respectiveadditional positions within the FOV_(W)
 9. The method of claim 8,wherein at least some of the first Tele image and the additional Teleimages partially overlap each other.
 10. The method of claim 8, whereinat least some of the first Tele image and the additional Tele images donot overlap each other.
 11. The method of claim 8, wherein the moving isperformed manually.
 12. The method of claim 8, wherein the moving isperformed automatically.
 13. A dual-aperture camera comprising: a) aWide camera that provides a Wide image with a Wide resolution and a Widefield of view (FOV_(W)), wherein the Wide camera includes a Wide lenswith a Wide lens optical axis and a Wide image sensor with a width W_(W)and a height H_(W) and wherein W_(W)>H_(W); and b) a folded Tele camerathat provides Tele images with a Tele resolution higher than the Widecamera resolution and with a Tele field of view (FOV_(T)) smaller thanFOV_(W), the dual-aperture camera configured to obtain a first Teleimage with the FOV_(T) at a respective first position within theFOV_(W), move the FOV_(T) relative to the FOV_(W) to obtain a secondTele image with the FOV_(T) at a second position within the FOV_(W), andfuse the Wide image, the first Tele image and the second Tele image intoa fused image, wherein the Tele camera includes a Tele image sensor witha width W_(T) and a height H_(T), wherein W_(T)>H_(T), wherein H_(T) isparallel to the Wide lens optical axis and wherein W_(W) is orthogonalto H_(T).
 14. The dual-aperture camera of claim 13, wherein the secondTele image partially overlaps the first Tele image.
 15. Thedual-aperture camera of claim 13, wherein the second Tele image does notoverlap the first Tele image.
 16. The dual-aperture camera of claim 13,wherein the dual-aperture camera is configured to move the FOV_(T)relative to the FOV_(W) manually.
 17. The dual-aperture camera of claim13, wherein the dual-aperture camera is configured to move the FOV_(T)relative to the FOV_(W) automatically.
 18. The dual-aperture camera ofclaim 13, wherein each of the first Tele image and the second Tele imageare indicated on a screen of the dual-aperture camera by a respectiveframe visible on the screen showing and defining the first FOV_(T) andthe second FOV_(T).
 19. The dual-aperture camera of claim 13, whereinthe dual-aperture camera is further configured to move the FOV_(T)relative to the FOV_(W) to obtain a plurality of additional Tele imageswith the FOV_(T) at respective additional positions within the FOV_(W.)20. The dual-aperture camera of claim 19, wherein at least some of thefirst Tele image and the additional Tele images partially overlap eachother.
 21. The dual-aperture camera of claim 19, wherein at least someof the first Tele image and the additional Tele images do not overlapeach other.
 22. A user interface (UI) for operating a dual-aperturecamera, the dual-aperture camera comprising a Wide camera with a Widefield of view (FOV_(W)) and a folded Tele camera with a changeable Telefield of view (FOV_(T)), wherein the Wide camera includes a Wide lenswith a Wide lens optical axis and a Wide image sensor with a width W_(W)and a height H_(W) and wherein the Tele camera includes a Tele imagesensor with a width W_(T) and a height H_(T), wherein W_(W)>H_(W),wherein W_(T)>H_(T), wherein H_(T) is parallel to the Wide lens opticalaxis and wherein W_(W) is orthogonal to H_(T), the UI comprising: a) ascreen configured to display a respective video including simultaneouslycaptured frames from the Tele and Wide cameras in which the FOV_(T) iswithin the FOV_(W); and b) a frame visible on the screen showing anddefining the FOV_(T) within the FOV_(W).
 23. The user interface of claim22, further comprising means for scanning the FOV_(T) across theFOV_(W).
 24. The user interface of claim 22, further comprising meansfor switching the screen from displaying simultaneously images from theWide and Tele cameras to displaying image from the Wide camera ordisplaying image from the Tele camera.
 25. The user interface of claim22, wherein the means for moving the FOV_(T) relative to the FOV_(W)include means to autonomously move the FOV_(T) relative to FOV_(W) totrack an object of interest.
 26. The user interface of claim 22, furthercomprising means for moving the FOV_(T) relative to the FOV_(W) thatinclude a finger touching the screen.
 27. The user interface of claim22, further comprising means for moving the FOV_(T) relative to theFOV_(W) that include a finger dragging the FOV_(T) on the screen.